Search results for "Conditional entropy"
showing 10 items of 24 documents
Entropy-Based Detection of Complexity and Nonlinearity in Short-Term Heart Period Variability under different Physiopathological States
2020
We compare different estimators of a popular en-tropy-based nonlinear dynamic measure, i.e. the conditional entropy (CE), as regards their ability to assess the complexity and nonlinearity of short-term heart rate variability (HRV). The CE is computed using binning, kernel and nearest neighbor entropy estimators in HRV time series measured from young, old and post-myocardial infarction patients studied at rest and during orthostatic stress. We find that the three estimators yield similar patterns of CE, but different patterns of nonlinear dynamics, across groups and conditions. These results suggest that the strategy for CE estimation is not crucial for the quantification of complexity, but…
Information domain approach to the investigation of cardio-vascular, cardio-pulmonary, and vasculo-pulmonary causal couplings
2011
The physiological mechanisms related to cardio-vascular (CV), cardio-pulmonary (CP), and vasculo-pulmonary (VP) regulation may be probed through multivariate time series analysis tools. This study applied an information domain approach for the evaluation of non-linear causality to the beat-to-beat variability series of heart period (t), systolic arterial pressure (s), and respiration (r) measured during tilt testing and paced breathing (PB) protocols. The approach quantifies the causal coupling from the series i to the series j (C(ij)) as the amount of information flowing from i to j. A measure of directionality is also obtained as the difference between two reciprocal causal couplings (D(i…
Reliability of Short-Term Heart Rate Variability Indexes Assessed through Photoplethysmography
2018
The gold standard method to monitor heart rate variability (HRV) comprises measuring the time series of interbeat interval durations from electrocardiographic (ECG) recordings. However, due to the widespread use, simplicity and usability of photoplethysmographic (PPG) techniques, monitoring pulse rate variability (PRV) from pulse wave recordings has become a viable alternative to standard HRV analysis. The present study investigates the accuracy of PRV, measured as a surrogate of HRV, for the quantification of descriptive indexes computed in the time domain (mean, variance), frequency domain (low-to-high frequency power ratio LF/HF, HF band central frequency) and information domain (entropy…
Information-based detection of nonlinear Granger causality in multivariate processes via a nonuniform embedding technique
2010
We present an approach, framed in information theory, to assess nonlinear causality between the subsystems of a whole stochastic or deterministic dynamical system. The approach follows a sequential procedure for nonuniform embedding of multivariate time series, whereby embedding vectors are built progressively on the basis of a minimization criterion applied to the entropy of the present state of the system conditioned to its past states. A corrected conditional entropy estimator compensating for the biasing effect of single points in the quantized hyperspace is used to guarantee the existence of a minimum entropy rate at which to terminate the procedure. The causal coupling is detected acc…
Multiscale Information Storage of Linear Long-Range Correlated Stochastic Processes
2019
Information storage, reflecting the capability of a dynamical system to keep predictable information during its evolution over time, is a key element of intrinsic distributed computation, useful for the description of the dynamical complexity of several physical and biological processes. Here we introduce a parametric approach which allows one to compute information storage across multiple timescales in stochastic processes displaying both short-term dynamics and long-range correlations (LRC). Our analysis is performed in the popular framework of multiscale entropy, whereby a time series is first "coarse grained" at the chosen timescale through low-pass filtering and downsampling, and then …
Lag-specific transfer entropy as a tool to assess cardiovascular and cardiorespiratory information transfer
2014
In the study of interacting physiological systems, model-free tools for time series analysis are fundamental to provide a proper description of how the coupling among systems arises from the multiple involved regulatory mechanisms. This study presents an approach which evaluates direction, magnitude, and exact timing of the information transfer between two time series belonging to a multivariate dataset. The approach performs a decomposition of the well-known transfer entropy (TE) which achieves 1) identifying, according to a lag-specific information-theoretic formulation of the concept of Granger causality, the set of time lags associated with significant information transfer, and 2) assig…
Entropy measures, entropy estimators, and their performance in quantifying complex dynamics: Effects of artifacts, nonstationarity, and long-range co…
2017
Entropy measures are widely applied to quantify the complexity of dynamical systems in diverse fields. However, the practical application of entropy methods is challenging, due to the variety of entropy measures and estimators and the complexity of real-world time series, including nonstationarities and long-range correlations (LRC). We conduct a systematic study on the performance, bias, and limitations of three basic measures (entropy, conditional entropy, information storage) and three traditionally used estimators (linear, kernel, nearest neighbor). We investigate the dependence of entropy measures on estimator- and process-specific parameters, and we show the effects of three types of …
Conditional Entropy-Based Evaluation of Information Dynamics in Physiological Systems
2014
We present a framework for quantifying the dynamics of information in coupled physiological systems based on the notion of conditional entropy (CondEn). First, we revisit some basic concepts of information dynamics, providing definitions of self entropy (SE), cross entropy (CE) and transfer entropy (TE) as measures of information storage and transfer in bivariate systems. We discuss also the generalization to multivariate systems, showing the importance of SE, CE and TE as relevant factors in the decomposition of the system predictive information. Then, we show how all these measures can be expressed in terms of CondEn, and devise accordingly a framework for their data-efficient estimation.…
Univariate and multivariate conditional entropy measures for the characterization of short-term cardiovascular complexity under physiological stress
2017
Objective: A defining feature of physiological systems under the neuroautonomic regulation is their dynamical complexity. The most common approach to assess physiological complexity from short-term recordings, i.e. to compute the rate of entropy generation of an individual system by means of measures of conditional entropy (CE), does not consider that complexity may change when the investigated system is part of a network of physiological interactions. This study aims at extending the concept of short-term complexity towards the perspective of network physiology, defining multivariate CE measures whereby multiple physiological processes are accounted for in the computation of entropy rates.…
Investigating the mechanisms of cardiovascular and cerebrovascular regulation in orthostatic syncope through an information decomposition strategy
2012
Some previous evidence suggests that postural related syncope is associated with defective mechanisms of cerebrovascular (CB) and cardiovascular (CV) control. We characterized the information processing in short-term CB regulation, from the variability of mean cerebral blood flow velocity (CBFV) and mean arterial pressure (AP), and in CV regulation, from the variability of heart period (HP) and systolic AP (SAP), in ten young subjects developing orthostatic syncope in response to prolonged head-up tilt testing. We exploited a novel information-theoretic approach that decomposes the information associated with a variability series into three amounts: the information stored in the series, the…